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Abstract 

A new lower bound for the average probability or error for a two-user discrete memoryless (DM) 
multiple-access channel (MAC) is derived. This bound has a structure very similar to the well-known 
sphere packing packing bound derived by Haroutunian. However, since explicitly imposes independence 
of the users' input distributions (conditioned on the time-sharing auxiliary variable) results in a tighter 
sphere-packing exponent in comparison to Haroutunian' s. Also, the relationship between average and 
maximal error probabilities is studied. Finally, by using a known sphere packing bound on the maximal 
probability of error, a lower bound on the average error probability is derived. 

Index Terms 

Multiple-access channel, error exponents, Sphere Packing bound. 

I. Introduction 

One of the most important practical questions which arises when we are designing or using an 
information transmission or processing system is: How much information can this system transmit or 
process in a given time? Information theory, developed by Claude E. Shannon during World War II, 
defines the notion of channel capacity and provides a mathematical model by which one can compute 
it. Basically, Shannon coding theorem and all newer versions of it treat the question of how much data 
can be reliably communicated from one point, or sets of points, to another point or sets of points. 

The class of channels to be considered include multiple transmitter and a single receiver. The received 
signal is corrupted both by noise and by mutual interference between the transmitters. Each of trans- 
mitters is fed by an information source, and each information source generates a sequence of messages. 
More specifically, a two-user DM-MAC is defined by a stochastic matrbJll W : X x y —> Z, where the 
input alphabets, X, y, and the output alphabet, Z, are finite sets. The channel transition probability for 
sequences of length n is given by 

n 

W n (z|x,y) ^Y[W( Zl \x u y t ) (1) 

i=l 

This work was supported by NSF ITR grant CCF-0427385. 

1 We use the following notation throughout this work. Script capitals U, X , y, Z,. . . denote finite, nonempty sets. To show the 
cardinality of a set X, we use \X\. We also use the letters P, Q,. . . for probability distributions on finite sets, and U, X, Y ,. . . for 
random variables. 
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where 



x^(o:i, ...,!„) £ X n ,y±( yi ,...,y n ) e y 



and 



z±( zi ,...,z n )ez n . 



It has been proven, by Ahlswede (T] and Liao's (6) coding theorem, that for any (Rx, Ry) m the interior 
of a certain set C, and for all sufficiently large n, there exists a multiuser code with an arbitrary small 
average probability of error. Conversely, for any (Rx,Ry) outside of C, the average probability of error 
is bounded away from 0. The set C, called capacity region for W, is the closure of the set of all rate pairs 
(Rx, Ry) satisfying [12) 



for all choices of joint distributions over the random variables U, X, Y, Z of the formp (u)p (x\u)p (y\u) W (z\x, y) 
with U <EU and \U\ < 4. As we can see, this theorem was presented in an asymptotic nature, i.e., it was 
proven that the error probability of the channel code can go to zero as the block length goes to infinity. It 
does not tell us how large the block length must be in order to achieve a specific error probability On the 
other hand, in practical situations, there are limitations on the delay of the communication. Additionally, 
the block length of the code cannot go to infinity. Therefore, it is important to study how the probability 
of error drops as the block length goes to infinity. A partial answer to this question is provided by 
examining the error exponent of the channel. 

Error exponents have been studied for discrete memoryless multiple-access channels over the past 
thirty years. Lower and upper bounds are known on the error exponent of these channels. The random 
coding bound in information theory provides a well-known lower bound for the reliability function of 
the best code, of a given rate and block length. This bound is constructed by upper-bounding the average 
error probability over an ensemble of codes. Slepian and Wolf [12], Dyachkov [3], Gallager [4], Pokorny 
and Wallmeier fill , and Liu and Hughes [7] have all studied the random coding bound for discrete 
memoryless multiple access channels. Nazari and et al. (8) investigated two different upper bounds on the 
average probability of error, called the typical random coding bound and the partial expurgated bound. 
The typical bound is basically the typical performance of the ensemble. By this, we mean that almost 
all random codes exhibit this performance. In addition, they have shown that the typical random code 
performs better than the average performance over the random coding ensemble, at least, at low rates. 
The random coding exponent may be improved at low rates by a process called "partial expurgation" 
which yields a new bound that exceeds the random coding bound at low rates. 

Haroutunian (5) and Nazari [9], lHOl studied upper bounds on the error exponent of multiple access 
channels. In Multi-user information theory, the sphere packing bound provides a well known upper 
bound on the reliability function for multiple access channel. The sphere packing bound that Haroutu- 
nian [5] derived on the average error exponent for DM-MAC is potentially loose, as it does not capture 
the separation of the encoders in the MAC. Nazari et al. llOl derived another sphere packing bound 
which takes into account separation of the encoders. The bound in flOl turns out to be at least as good as 



< Rx < I {X A Z\Y 7 U) 
0<R Y < I(Y AZ\X, U) 
0<Rx + Ry<I (XY A Z\U) 



(2b) 



(2a) 



(2c) 
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the bound derived in [5|, however it is a valid bound only for the maximal error exponent and not the 
average. The sphere packing bound is a good bound in high rate regime. Nevertheless, it tends to be a 
loose bound in low rate regime. It can be shown that in low rate regime, the minimum distance of the code 
dominates the probability of error. Using the minimum distance of the code, Nazari |9[ derived another 
upper bound for the maximal error exponent of DM-MAC. To derive the minimum distance bound, they 
established a connection between the minimum distance of the code and the maximum probability of 
error; then, by obtaining an upper bound on the minimum distance of all codes with certain rates, they 
derived a lower bound on the maximal error probability that can be obtained by a code with a certain 
rate pair. 

The paper is organized as follows. Some preliminaries are introduced in section [TU The main result of 
the paper, which is an upper bound on the reliability function of the channel, is obtained in section [III] 
In section HVl by using a known upper bound on the maximum error exponent function, we derive an 
upper bound on the average error exponent function. The proofs of some of these results are given in 
the Appendix. 

II. Preliminaries 

For any alphabet X, V (X) denotes the set of all probability distributions on X. The type of a sequence 
x = (xi,...,x n ) G X n is the distributions P x , on X, defined by: 

P x (x)±-N(x\x), xeX, (3) 

n 

where N (x\x) denotes the number of occurrences of x in x. Let V„ (X) denotes the set of all types in 
X n , and define the set of all sequences in X n of type P as 

Tp = {x G X n : P x = P}. (4) 

The joint type of a pair (x, y) G X n x y n is the probability distribution P x y on X x y defined by: 

Px, y (x,y)±-N(x,y\x,y), (x,y)eXxy, (5) 

n 

where N (x, y|x, y) is the number of occurrences of (x, y) in (x, y). The relative entropy or Kullback-Leibler 
distance between two probability distribution P,Q eV (X) is defined as 

D(P\\Q)^J2P(x)log^\. (6) 
xex ^ [x> 

Let W (y\X) denote the set of all stochastic matrices with input alphabet X and output alphabet y. Then, 
given stochastic matrices V, W € W (y\X), the conditional 1-divergence is defined by 

D{V\\W\P)^Y. P ^ D ^ V ^ X )\\ W ^- ( ? ) 

xex 

Definition 1. An (n, M, N) multi-user code is a set (: x,.y ,. I), , i : 1 < i < M, 1 < j < N} with 
. x, G X n , y.j G y n , Dij C Z n 
. n% = for ^ (£',/)• 
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The average error probability of this code for the MAC, W : X x y — > Z, is defined as 

M N 

MN 



e - ik E E wn (< r >, x -^» ■ ( 8 ) 

i=l j=l 

Similarly, the maximal error probability of this code for W is defined as 

e m (C, W) 4 maxF (Z^Jx,, y,) . (9) 

(ij) 

Definition 2. For f/ze MAC, W : X x y ^ Z, the average and maximal error reliability functions, at rate pair 
(Rx,Ry), are defined as: 

E* {R x ,Ry) = lim max— log e (C, W) (10) 

ri-yoo C n 

E* m {R x ,R Y ) = Urn mzx--loge m (C,W), (11) 

n— >oo C n 

w/iere the maximum is over all codes of length n and rate pair (Rx,Ry). 

Definition 3. A code Cx = {x,: e X n : i = 1, Mx}, /or some Py, is called a bad codebook, if 

3 , j x » = x o (12) 
A codebook which is not bad, is called a good one. 

Definition 4. A multi user code C — Cx x Cy is called a good multi user code, if both individual codebooks Cx, 
Cy are good codes. 

Definition 5. For a good multi user code C = Cx x Cy, and for a particular type Pxy S V n (X x y), we define 

R(C,Pxy) = -\og\CnT PxY \ (13) 
n 

Definition 6. For a sequence of joint types P^ Y £ V n (X x y), with marginal types P£ and Py, the sequence 
of type graphs, G n , is defined as follows: For every n, G n is a bipartite graph, with its left vertices consisting of 
all x n € Tpn and the right vertices consisting of all y n 6 Tpn, A vertex on the left (say x n ) is connected to a 
vertex on the right (say y n ) if and only if (x n ,y n ) € Tp^ Y . 

III. MAIN RESULT 

The main result of this section is a new sphere packing bound for the average error probability for a 
discrete memoryless multiple access channel. The idea behind the derivation of this bound is based on 
the property that is common among all good multi user codes with certain rate pair. In the following, we 
first derive a sphere packing bound for a good multiuser code. Next, we show that for any bad multiuser 
code, there exists a good code with the same rate pair and smaller average probability of error. Therefore, 
to obtain a lower bound for the average error probability for the best code, we only need to study good 
codes (codes without any repeated codewords). 

Now, consider a good multiuser code with blocklength n. Suppose the number of messages of the 
first source is Mx = 2 nRx and the number of messages of the second source is My = 2 uRy . Assume 
that all the messages of any source are equiprobable and the sources are sending data independently. 
Considering these assumptions, all MxMy pairs are occuring with the equal probability. Thus, at the 
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input of the channel, we can see all possible 2 n ^ Rx+RY ^ (an exponentially increasing function of n) pairs 
of input sequences. However, we also know that the number of possible types is a polynomial function 
of n. Thus, for at least one joint type, the number of pairs of sequences in the multi user code sharing 
that particular type, should be an exponential function of n with the rate arbitrary close to the rate of 
the multi user code. We will look at these pairs of sequences as a subcode, and then try to find a lower 
bound for the average error probability of this subcode. Following, we will show that this bound is a 
valid lower bound for the average probability of error for the original code. 

Lemma 1. For any 8 > 0,/or any sufficiently large n, and for any good (n, 2 nRx , 2 NRy ) multi user code C, 
as defined above, there exists Pxy 6 V n (X x y) such that 

R (C, Pxy) > Rx + Ry - 5 far sufficiently large n, 

Pxy is called a dominant type of C. 

Hence, for any good code, there must exist at least a joint type which dominates the codebook. We 
can ask the following question: for a multiuser code, with rate (Rx, Ry), can any joint type potentially 
be its dominant type? As shown later, the answer to this question helps us characterize a tighter sphere 
packing bound. In response to this question, Nazari et al. studied the type graphs for different joint 
types and proved the following result: 

Lemma 2. iO For all sequences of nearly complete subgraphs of a particular type graph Tp XY , the rates of the 
subgraph (Rx,Ry) must satisfy 

Rx < H (X\U) , R Y < H (Y\U) (14) 

for some Pu\xy sucn that X — U — Y. 

Now consider a particular joint type P X y By me previous lemma, if there does not exist any Pjj\xy 
satisfying the constraint mentioned in lemma |2j the type graph corresponding to this joint type can not 
contain an almost fully connected subgraph with rate (Rx,Ry)- Consequently, it cannot be the dominant 
type of a good multiuser code with rate (Rx 7 Ry)- 

Fact 1. Consider a good multiuser code C with parameter (n, 2 nRx ,2 nRY ). A joint type Pxy e ^« x 30 can 
be the dominant type of C if there exists a Pu\xy, X — U — Y, such that 

Rx < H (X\U) , R Y < H (Y\U) , (15) 

conversely, if it does not exist such a conditional distribution, then P XY cannot be the dominant type of any good 
midtiuser code with parameter (n, 2 nRx , 2 nRv ). 

Theorem 1. Fix any Rx > 0, Ry > 0, S > and a sufficiently large n. Consider a good midtiuser code C with 
parameter (n, 2 nRx , 2 nRv ) which has a dominant type P XY e V n {X x y). The average error exponent of such 
a code is bounded above by 

E sp (R x ,R Y ,W)^ mm D (V z \xy\\W\P X y) ■ (16) 
Here, the minimization is over all possible conditional distributions Vz\xy ■ X x y — > Z, which satisfy at least 
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one of the following conditions 

Iv(XAZ\Y) < R x (17) 

I V (YAZ\X) < R Y (18) 

Iv(XYAZ) < Rx+Ry- (19) 

Proof: The proof is provided in Appendix A.l. ■ 
In theorem [TJ we obtained a sphere packing bound on the average error exponent for a good multiuser 
code with a certain dominant type. For a more general code, we do not know the dominant type of the 
code. However, we do have the condition for a joint type to be the potential dominant type of a code 
with certain parameter. By combining the result of theorem [TJ and fact [TJ we can obtain the following 
sphere packing bound for any good multiuser code: 

Theorem 2. For any given multiple access channel W and any good multi user code with rate pair (Rx,Ry), 
the reliability function, E (Rx,Ry, W), is bounded above by 

E sp (R x ,R Y ,W)^ max min D (V Z \ XY \\W\P XY ) ■ (20) 

PuXY Vz\XY 

Here, the maximum is taken over all possible joint distributions satisfying X — U — Y and 

Rx < H (X\U) , R Y < H (Y\U) , (21) 

and the minimum over all channels Vz\xy that satisfy at least one of the following conditions 

I V {XAZ\Y) < R x (22) 
I V (YAZ\X) < R Y (23) 
I V (XYAZ) < Rx+Ry- (24) 

Thus far, we have obtained a lower bound on the average error probability for all good multiuser codes 
with certain rate pairs. Here, we show that the result of the previous theorem is indeed a valid bound for 
any multiuser code regardless of whether it is good or bad. This approach shows that for any bad code 
there exists a good code with the same number of codewords and a better performance. Therefore, to 
obtain a lower bound on the error probability of the best code, we only need to consider codes without 
any repeated codewords. In lemma [3J we prove this result for a single-user code and later, by using the 
result of lemma [3] several times, we prove the same result for the multiuser scenario. 

Lemma 3. Suppose Cx is a codebook of size Mx for which all codewords are selected from Tp x . Moreover, 
suppose Xj is repeated Ni times in the codebook and Mx = Ni+N 2 + ... + Nm, where M is the number of distinct 
sequences in Cx- If Mx < \Tp x \ — 1, there exists another code C' x with better probability of error, such that 

\Cx\ = \C' X \ 

N[ = N t i = l,...,M-l 

N' M - N M -1 

N'm+i = 1 (25) 
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Here, N' M+1 = 1 is the number of occurrences of the new sequence x e Tp x which does not belong to C x . 

Proof. The proof is provided in Appendix A.2. ■ 

Lemma 4. For any bad multi user code with codewords that belong to Tp x , and Tp Y , with rate pair (Rx,Ry), 
there exists a good multi user code with the same rate pair and a better probability of error. 

Proof. For a bad multi user code, we know that at least one of the individual codebooks is bad. If 
we apply lemma [3] several times to any of the bad single user codes, with the appropriate cardinality 
we will end up with a good multiuser code and a better probability of decoding error. ■ 
Finally, by combining the result of lemma [4] and the result of theorem |2j we deduce an upper bound 
on the reliability function for all multiuser codes. 

Theorem 3. For any given multiple access channel W, and any good multi user code with rate pair (Rx,Ry), 
the reliability function, E (R x , Ry,W), is bounded above by 

E sp (R x ,R Y ,W) 4 max min D (V Z \ XY \\W\P XY ) . (26) 

'XY V Z \XY 

Here, the maximum is taken over all possible joint distributions, and the minimum over all channels Vz\xy which 
satisfy at least one of the following conditions 

I v {X A Z\Y) < R x 
I v (Y A Z\X) < R Y 

Iv(XYAZ) < Rx+Ry (27) 

IV. Another Sphere packing bound 

In point to point communications systems, one can show that a lower bound for the maximal error 
probability of the best code is also a lower bound on the average probability of error for such a code. 
However, in multiuser communications, this is not the case. It has been shown that for multiuser channels, 
in general, the maximal error capacity region is smaller than the average error capacity region @. 
Therefore, we cannot hope a sphere packing bound for maximal error probability to be equal to the 
one for the average probability of error. In the following, we show an approach to derive an upper 
bound on the average error exponent by using a known upper bound for the maximal error exponent. 

Lemma 5. Fix any DM-MAC W : X x y — > Z, Rx > 0, R Y > 0. Assume that, the maximal reliability function 
is bounded as follozvs: 

E m (Rx,Ry) < Em (Rx,Ry) < (R x , Ry) , (28) 
therefore, the average reliability function can be bounded by 

E m {R x ,Ry) < E* av (R x ,Ry) < E m (R x ,Ry) + R, (29) 
where R = mm{R x , Ry}- Similarly, if the average reliability function is bounded as follows: 

E av (Rx, Ry) < E* v (R x ,Ry) < E% v (Rx,Ry) , (30) 
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it can be concluded that the maximal reliability function satisfies the following constraint 

E L av (R x ,Ry) -R< E* m (R x ,Ry) < E v av (R x ,Ry) ■ (31) 

Proof: The proof is provided in Appendix A. 3. ■ 
In ITOl , the authors derived a sphere packing bound on the maximal reliability function for DM-MAC. 
This results is only a valid upper bound for the maximal error reliability function and not the average 
one. We can simply use the previous lemma to derive a new upper bound on the average error reliability 
function for DM-MAC. 

Theorem 4. For any R x ,Ry > 0, S > and any DM-MAC, W : X x y ->■ Z, every (n,M x ,M Y ) code, C 
with 

-\ogM x >R x +8 (32a) 
n 

- log M Y > Ry +5, (32b) 

n 

has average probability of error 

e(C,W) > ^exp(-n(E™(R x ,R Y ,W) + R) (1 + 6)), (33) 
where E^i is the sphere packing bound derived in iflQlf , and R = min{R x , Ry}- 

V. Appendix 

A. Appendix A.l 

For a given MAC W : X x y — > Z and a good multi user code C = C x x Cy, where C x = { X; G X n : 
i = 1, M x } and C Y = { y.j G y n ■ j = 1, M Y }, with decoding sets Aj C Z n , we have 

M x M Y 

M X M Y 



M x M Y 

= XTT^EE^A^x.) (34) 



i=l 3=1 

- JskEtLE -(^l-.x.) (35) 

-Pxi- {i-j)£Cxy 

where C X y is the set that includes all pairs in C x x Cy which have the same type P X y, M X y denotes 
the cardinality of this set, and R X y = \ log Mjfy. For a fixed TV (xi,Xj)s are disjoint subsets of Z n 
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M X M Y ^ M X y 

r Pxy AY (i,j)ec X Y v 



1 V- n r ST 1 V w^r r , , • • J^o n ^ (x 4 , y,) 



MxMy p V M ^f,-^ v-w,,.,,,,, |Tv(x l;yj )| 

= 1 v Af. , v2-" Dfv||vy|Pyy) fi 5— v \ Di ' j n7 v( x »yj) 

MxMyf- XY ^ [ Mxy .. ~L |Tv(x i!yi )| 

> 1 V Mi . Vr^'^'^Hi 5— V nr v (x i ,y J -) 

" M x M y ^ XY ^ 1 M X y ^ 2 nH ( z \ x > Y ) 

A * Pxy V AY (i,j)&C X Y 



_2 V- M STo-nD(V\\W\PxY)[i 1 I U('M)egxy D ^ nTv ( X ^Vj) 

M X M Y ^ XY ^ [ M XY 2 nH ( z \ x ' Y ) 

1 Pxy V 

> 1 V MYvV2-" D < l 'll ft 'l P;ty) [l - 1 ^ 1 
~ M x My ^ XY Z^, L M^ 9.nff(2|X,l') J 

> V Afxy V2-" D(v||w|p ^ ) fl 



1 2 " ff ( z ) 



M X M Y ^ ^ M XY 2 nH ( z \ x > Y ) 1 

Pxy V 

1 V 0- nD ( v \\ w \ p xY)\i _o-n[RxY-Iv{XYAZ)U 

M X M Y ^ XY ^ [ J 

A y Pxy V 



We define 



t£f = {V : R XY > Iv (XY A Z)} 



So, form the last inequality, 



e(C,W) > -J—^Mxy £ 2- nDmP * Y) 



M X M Y p 



> 1 v MxY2- n[miUv ^ x J D <r" w ^ 

- M X M Y 

Pxy 

1 ^ -n[mm v v xy D(V\\W\P xy )-Rxy] 

— > Z bad 

M X M Y ^ 

Pxy 
-n[minp XY 

mm. , iD(V| | W| Pxy") — Rxy] 



> 



M X M Y 



Thus, 



e (C, > 2 



n[minp x „ min Iv -D(V||lV|P X y)+-Rx+-Ry--Rjcy] 



bad 
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On the other hand, if we use the fact that D^ - C (J ., IJj'/j A',j', we can conclude 

Mx My 

e(C '^ = jj^EE^W*'*) (50) 

i=l 3=1 

My Mx / \ 

3=1 l =l \ J' / 

Define.^ = |J U ^'^ (52) 



M^EE E E^^n^Cx^y,)^,^) (53) 

Pxy i j--(i,j)£C X Y v 
__}_ 9 -nD(V\\W\P XY ) [J'f nTy(x t ,y J )| 

M x M y ^^ 2 Ytw l^(x i>yj -)l { } 

Pxy V » ].{i,j)eC X Y 

ST ST -nD{V\\W\PxY) 1 V" \^ [i |AnTy(x i ,yj)| 1 

W L . r ^ [ |Tv(x i)yi )| J (b5) 

W2~" c(y|lw|Pxy) Mxy n 1 V V IA nr y (x I; y 3 ) | 

^ ^ MxMy M X y^ ^ |Ty(Xi,y,-)| 



(57) 



> o-n_D(y||iy|p Y y) Mxy n 1 IA n T y (x i; y^) | 

~ ktv MxMy MxY tth \ T v^yi)\ 

> Wo-nwnw^i ri i IAnr y (x i ,y j )| 

" M X My [ M XY ^^ 2 nH(Z\X,Y) \ ^> 

Pxy V j=l i=l 

ii.f i m y nH(Z,X\Y) 

\p \p 2 -nD(V\\W\PxY) M XY r 1 V 2 . 1 ( 59 ) 

2^2^ Z M X M Y [ M XY ^ 2 nH ( z \ x - Y ) 1 ( ' 

Pxy V j=l 

> yro^owifffey) MxY m 2- niRxY - RY - Iv(ZAX ^ Y)] } (60) 
~ ^ ^ M X M Y 

Pxy V A * 



> 



and now, let us define 



V b x d ^{V:RxY-R Y >Iv(ZAX\Y)} (61) 

Hence, it easily can be seen 

e(C,W) > Ji - w Y, M xy E (62) 

X Y P ^ VeV* d 

J2 M XY 2- n[minv ^ D ^ W ^ (63) 



> 



M X My 
A y Px 



So, 



1 \p 2 -n[min V( . v x d D(V\\W\PxY)-RxY] ( ^ 

MxMy ^ ( ' 
Pxy 

> 1 -n[mm PxY min vev x^ D(V\\W\P X y)-Rxy] . j., 

" MxMy 1 j 
e (C W) > 2 ^ minFxY miUvev bid d< - v W w \ Px y)+ r x+Ry-Rxy] 
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Using the same idea for Y and defining Dj = 1J., Uj'^j Di>j>, we can easily see 

e(C,W) > £ 2- D ^ w ^ (67) 



M X M Y 



> 



1 »r n -n[min Vf „ r D(V||W|P X y)] 



^M^" 1 ^^, mm ™ (68) 



So, 



where 



M X M Y 

1 \ - -»[min vev .y D(V||VK|P X y)-H X y] 

MxMy ^ K ' 

> 1 -n[min Pxy min y£V y^ g(V r ||VK|Pxy)--Rxy] ,r,„v 

~ MxMy " ad 

e (C W) > 2 _n ' mini>xv millvev b«d £, (V||lV|Pxy)+-Rx+-Ry---Rxy] 



V^ = {7:iJxy-iZ x >J v (ZAy|Jf)} (72) 

From (64),(81),(86), 

Equivalently, for the exponent of e (C, W) 

B (C, W) < min min Z? (VIIWIPxy) + #x + Ry - Rxy (74) 

If we define V(, a(J = Vj£ d U V b ^ d U V£J , for every code C, we have 

E{C,W) < max min min D {V\\ W\P XY ) + Rx + Ry - Rxy (75) 

c Pxy vav bad 

= max min min D (V II W\P X y) + Rx + Ry - Rxy (76) 

RGTZ Pxy VdV bad 

Where R is a vector with elements R (C, Pxy) and 7Z is the set of all possible vectors R. The last inequality 
follows from the fact that E (C, W) is only a function of Rxys. Since P X y * s the dominant type of the 
code, we conclude that 

E(C,W) < max min D (V\\W\P XY ) + R x + R Y - R* XY ( 77 ) 

= max min D(V\\W\Pt Y ) . (78) 
Ren vev bad 

However, this expression does not depend on R. Therefore 

E(C,W) < min D(V\\W\P XY ), (79) 
where V bad = {V : I v (XY A Z) < R x + R Y or I v (Y A Z\X) < R Y or I v (X A Z\Y) < R x } 
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B. Appendix A.2 

Suppose the decoding regions for Cx are Di, D%, ...Dm- Hence, 

, M x 

e(C x ,W) = —Y^W(DZ\i) 

^ 2—1 

Af 

_r 

M x 



(N t W (A c |x.) + (Ni -1)W (A-lx.-))] 

^ (m x - m +jy -{m\*)\ ■ 



(80) 



Let us randomly choose x £ Tp x that does not belong to Cx- Define 



V = argrnin{D (V\\W\P X ) + H (V\P X )} (81) 

it is proved that if y £ T Vo (x) 

W n (y\x) = 2~ n[minv{D{v ^ wlPx)+H{vlPx}}] 

> 2 -n[{B(V||w|f> x )+ir(V|F x )}] any V 

= W n (y|x') (82) 

for some x' such that y £ Ty (x'). Thus, 

If™ (y|x) > W n (y|xj) any t = 1, ...M (83) 

Choose y £ Ty (x) flDfe for some k with |Di.| > 2. Now, let us look at C' x which contains all codewords in 
Cx except one of the repeated ones, i.e one of the Xm which is replaced with x, and define the decoding 
sets 

£>■ = Di i^k (84) 

D' k = D k -{y} (85) 
d 'm+i = M where x j\/+i - x - (86) 

By following a similar approach, we conclude that 



M 

e'{C x ,W) = —[M x -M+ J2 Wm^) + W(D' k c \x k )~W(j\x) 



1 M 

= W~ ( Mx ~ M + E W(D°\xi)W(D' k c \x k ) - W(y\x) - W{D%\x k ) 



x 



<C x ,W) + ^(w(y\x k )-W(y\x)) 



M x 

<e(C x ,W), (87) 
where the last inequality follows from the fact that W (y\x k ) < W (y\x). 
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C. Appendix A.3 

The left hand side of (|29l l is straightforward, since for all multiuser codes, C, e m (C,W) > e(C,W). 
By | |2"8l l, for all multiuser codes with rate pair (Rx, Ry), we can conclude that 

e m {C,W) > 2- nE "^ Rx < RY K (88) 

Let us assume that there exists a code C with rate pair (Rx,Ry) for which the right hand side of j2"9|l 
does not hold. Without loss of generality, we assume Rx < Ry- For Therefore, 

e(C,W) < I 2 -"K^ fl ^ +i H 

which is equivalent to 

M x M Y 

]j^VEE W < ^2- n ( E ™ {Rx ' RY)+Rx \ (89) 
x Y i=l i=i 

which can be written as 

My Mx 

iEiE^(^i x ^i) < i 2 -««^^)— ), (90) 

3=1 i=l 



therefore, there exist My > codewords in Cy that satisfy 

-, Mx 

irY. w ^PU^) <2-««(«-wu). (9i) 



z— 1 



Let us call this set of codewords as C\. By multiplying both sides of l l9"Tll with Mx, and considering the 
fact that all terms in summation are non-negative, it can be concluded that for every 6 Cx, yj G C\, 

W (/)',, x,.x/) < 2- n ( E ^ R *' R rt). (92) 

Therefore, the new multiuser code C 1 = Cx x C Y , has a rate pair very close to the original code, and its 
maximal probability of error satisfies 

e m (C\W)<2-< E ^ R - R ^). (93) 



contradicts our assumption in 1881 . therefore it can be concluded that the assumption must be false 
and that its opposite must be true. Similarly, we can show the bounds in l|3~TT l by assumption in d30b . 
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